Express Mail Label No. EL718783545US 



INFORMATION SECURITY USING DIGITAL HOLOGRAPHY 



TECHNICAL FIELD OF THE INVENTION 



This invention relates to a method and system for encrypting and decrypting 
multi-dimensional information, objects or data with digital holography. 

5 BACKGROUND OF THE INVENTION 



The application of optical processing systems to security, verification, and 
encryption of information has been explored previously (H.-Y. Li, Y. Qiao, and D. 
Psaltis, "Optical Network For Real-time Face Recognition," Appl Opt. 32, 5026-5035 
(1993); B. Javidi and J. L. Horner, "Optical Pattern Recognition For Validation and 

10 Security Verification" Opt. Eng. 33, 1752-1756 (1994); Ph. Refregier and B. Javidi, 
"Optical Image Encryption Based on Input Plane and Fourier Plane Random 
Encoding" Opt Lett 20, 767-769 (1995); C. L. Wilson, C. I. Watson, and E. G. 
Paek, "Combined Optical and Neural Network Fingerprint Matching," Proc. SPIE 
3073, 373-382 (1997); N. Yoshikawa, M. Itoh, and T. Yatagai, "Binary Computer- 

15 generated Holograms for Security Applications From A Synthetic Double-exposure 
Method by Electron-beam Lithography," Opt Lett 23, 1483-1485 (1998) and O. 
Matoba and B. Javidi, "Encrypted Optical Memory System Using Three-dimensional 
Keys in the Fresnel Domain," Opt. Lett. 24, 762-764 (1999); which are incorporated 
herein by reference). 

20 In one approach, the information to be secured or verified is encoded as a two- 

dimensional image using amplitude, phase, polarization or wavelength modulation of 
light and optically processed. In order to encrypt the information, random phase-codes 
can be used to modify the Fraunhofer or Fresnel diffraction patterns of the input 
image (B. Javidi and J. L. Horner, "Optical Pattern Recognition For Validation and 

25 Security Verification," Opt Eng. 33, 1752-1756 (1994); Ph. Refregier and B. Javidi, 
"Optical Image Encryption Based on Input Plane and Fourier Plane Random 
Encoding," Opt. Lett 20, 767-769 (1995) and O. Matoba and B. Javidi, "Encrypted 
Optical Memory System Using Three-dimensional Keys in the Fresnel Domain," Opt 
Lett. 24, 762-764 (1999)) as in methods for securing or multiplexing holographic 
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memories (J. E. Ford, Y. Fainman, and S. H. Lee, "Array Interconnection By Phase- 
coded Optical Correlation" Opt Lett. 15, 1088-1 090 (1990); C. Denz, G. Pauliat, G. 
Roosen, and T. Tschudi, "Volume Hologram Multiplexing Using A Deterministic 
Phase Encoding Method," Opt Commun. 85, 171-176 (1991); H. Lee and S. JL Jin, 
5 "Experimental Study of Volume Holographic Interconnects Using Random Patterns," 
AppL Phys. Lett 62, 2191-2193 (1993); J. F. Heanue, M. C. Bashaw, and L. 
Hesselink, "Encrypted Holographic Data Storage Based on Orthogonal-phase-code 
Multiplexing/'^/?/. Opt 34, 6012-6015 (1995); C. Denz, K. O. Mueller, F. Visinka, 
and T. I. Tschudi, "Digital Volume Holographic Data Storage Using Phase-coded 
10 Multiplexing," Proc. SPIE. 3802, 142-147 (1999) and C. C. Sun, W. C. Su, B. Wang, 
and Y. Ouyang, "Diffraction Selectivity of Holograms With Random Phase 
Encoding," Opt Commun. 175, 67-74 (2000) which are incorporated herein by 
reference). 

In general, the encrypted image contains both amplitude and phase and thus 
15 holographic recording may also be required (J. W. Goodman, Introduction to Fourier 
Optics, McGraw-Hill, New York, 1996 which is incorporated herein by reference). 
This necessity makes it difficult to transmit the encrypted information over 
conventional communication channels. 

Several digital holography methods have been applied to solve the previous 
20 problem by recording fully complex information with electronic cameras (U. Schnars 
and W. P. O. Juptner, "Direct Recording of Holograms By A CCD Target and 
Numerical Reconstruction"^?/. Opt 33, 179-18 1 (1994); Y. Takaki, H. Kawai, 
and H. Ohzu, "Hybrid Holographic Microscopy Free of Conjugate and Zero-order 
Images," AppL Opt 38, 4990-4996 (1999) and E. Cuche, F. Bevilacqua, and C. 
25 Depeursinge, "Digital Holography For Quantitative Phase-contrast Imaging," Opt. 
Lett 24, 291-293 (1999) which are incorporated herein by reference). Among them, 
digital phase-shifting interferometry stands out as a versatile and efficient technique 
(J. H. Bruning, D. R. Herriott, J. E. Gallagher, D. P. Rosenfeld, A. D. White, and D. J. 
Brangaccio, "Digital Wavefront Measuring Interferometer For Testing Optical Sur- 
30 faces And Lenses," v4/?/?/. Opt. 13, 2693-2703 (1974); J. Schwider, "Advanced 

Evaluation Techniques In Interferometry," in: Progress in Optics, Vol. XXVIII, ed. E. 
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Wolf, pp. 271-359 (North-Holland, Amsterdam, 1990) and L Yamaguchi and T. 
Zhang, "Phase-shifting Digital Holography," Opt Lett 22, 1268-1270 (1997) which 
are incorporated herein by reference), 

A first attempt to electronically record the holographic information associated 
5 with a two-dimensional encrypted image has already been reported by using off-axis 
digital holography (B. Javidi and T. Nomura, "Securing Information By Means Of 
Digital Holography," Opt. Lett 25, 28-30 (2000) which is incorporated herein by 
reference) and inline digital holography (E. Tajahuerce, O. Matoba, S.C. Verrall, and 
B. Javidi, "Optoelectronic Information Encryption With Phase- shifting 
10 Interferometry", Appl Opt 39, 23 13-2320 (2000) which is incorporated herein by 
reference). In this way, advantages of optical encryption such as speed, large number 
of degrees of freedom and high security, are combined with the usefulness of 
electronic information transmission. 

Optical encryption and security are recent applications of optical information 

15 processing. (F, Goudail, F, Bollaro, B. Javidi, and Ph. Refregier, "Influence of A 
Perturbation In A Double Phase-encoding System," J. Opt, Soc. Am. A 15, 2629- 
2638(1998); H.Y. Li, Qiao and D. Psaltis, "Optical Network For Real-time Face 
Recognition,"^/?/. Opt. 32, 5026-5035 (1993); Ph. LaLanne, H, Richard, J.C. 
Rodier, P. Chavel, J. Taboury, K. Madani, P. Garda and F. Devos, "2D Generation of 

20 Random Numbers By Multimode Fiber Speckle for Silicon Arrays of Processing 
Elements," Opt. Commun. 76, 387-394 (1990) and JX. Horner and B. Javidi, eds., 
Optical Engineering Special Issue on Optical Security(SPIE, Belingham, Wash., 
1999), Vol. 38, which are incorporated herein by reference). Optical systems present 
a good potential for these tasks because, they provide a large degree of freedom to 

25 secure data. Several different techniques exist to secure and store data by phase 
encoding. (T.F. Krile, M.O. Hagler, W.D. Redus and J.F. Walkup, "Multiplex 
Holography With Chirp-modulated Binary Phase-coded Reference-beam Masks," 
Appl Opt 18, 52-56 (1979) and Y.H. Kang, K.H. Kim and B. Lee "Volume 
Hologram Scheme Using Optical Fiber for Spatial Multiplexing," Opt Lett. 22, 739- 

30 741 (1997) which are incorporated herein by reference) In each case the encrypted 
data are fully complex and thus may be recorded and stored holographically. (HJ. 
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Caulfield, ed., Handbook of Optical Holography (Academic, London, 1979) which is 
incorporated herein by reference). A high quality reconstruction can be obtained by 
use of a high density analog recording medium. However, information recorded in 
this way is difficult to transmit over digital communication lines. If not digitized, or 
5 converted in some way, this information must be reconstructed optically. 

One way in which fully complex information may be stored or communicated 
digitally is to record it with digital holography. (L. Onural and P.D. Scott, "Digital 
Decoding of In-line Holograms," Opt. Eng. 26, 1124-1132 (1987); U. Schnarrs, 
"Direct Phase Determination In Hologram Interferometry With Use of Digitally 

10 Recorded Holograms," J. Opt. Soc. Am. A 11, 2011-2015 (1994); G. Pedrini, Y.L. 
Zou and H J. Tiziani, "Digital Double-pulsed Holographic Interferometry for 
Vibration Analysis," J. Mod. Opt. 40, 367-374 (1995); J.C Marron and K.S. 
Schroeder, "Three-dimensional Lensless Imaging Using Laser Frequency Diversity," 
Appl Opt. 31, 255-262 (1992); U. Schnarrs, TJVL Kreis and W.P.O. Juptner, "Digital 

15 Recording and Numerical Reconstruction of Holograms: Reduction of the Spatial 

Frequency Spectrum " Opt. Eng. 35, 977-982 (1996) and E. Cuche, F. Bevilaqua and 
C. Depeursinge, "Digital Holography for Quantitative Phase-contrast Imaging," Opt. 
Lett. 24, 291-293 (1993) which are incorporated herein by reference). With this 
method holograms are captured by an electronic camera and reconstructed by use of a 

20 digital computer that approximates a diffraction integral. These digital holograms 
may also be reconstructed optically, but digital reconstruction allows the focus to be 
adjusted electronically. 

A method for using the CCD capabilities more efficiently is by digital phase- 
shifting interferometry to record the fully complex information. (K. Creath, "Phase- 

25 measurement Interferometry Techniques," in Progress In Optics, E. Wolf, ed. (North- 
Holland, Amsterdam, 1990), Vol. XXVI, pp. 349-393 and T.Zhang and I. Yamaguchi, 
"Three-dimensional Microscopy With Phase-shifting Digital Holography," Opt. Lett. 
23, 1221-1223 (1998) which are incorporated herein by reference). This phase- 
measurement technique is more precise than that of digitally recording an off-axis 

30 hologram. Generally, the system errors decrease with an increase in the number of 
phase-shift steps used to infer the fully complex information. However, it should be 
noted that, with currently available technology, the largest sources of system errors 
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are the limited resolution and dynamic range of commercially available CCD arrays. 

SUMMARY OF THE INVENTION 

A method and system for encrypting and decrypting multi-dimensional 
information or data by using digital holography is disclosed. A phase-shifting 
5 interferometer records the phase and amplitude information generated by an object at 
a plane located in the Fourier or Fresnel diffraction region in an intensity-recording 
device. This information is encrypted with the Fourier or Fresnel diffraction pattern 
generated by a random phase mask and stored electronically. To perform decryption, 
a key is also electronically recorded by phase-shifting interferometry. The encrypted 
1 0 hologram can be transmitted electronically to remote locations but can only be 
decoded with the proper keys. 

After decryption, images of the object, focused at different planes, can be 
generated digitally or optically. The method allows for the reconstruction of the 
object with different perspectives from a single encrypted image. The method does 
15 not require sending the key exclusively through a digital communication channel. 
Instead, a copy of the random phase key itself can be sent to the authorized user. 

A method of forming a remote image of an object is disclosed. The method 
comprises forming a hologram of the object; compressing the hologram of the object; 
transmitting the compressed hologram of the object to remote locations over a 
20 distributed computer network; decompressing the compressed hologram of the object; 
and reconstructing the object from the decompressed hologram of the object. 

EXPLANATION OF THE DRAWINGS 

Figure lis a first schematic diagram of a phase-shifting holographic system for 
encrypting multi-dimensional information. 

25 Figure 2 is a schematic diagram of the location of the window in the hologram 

to generate different vertical perspectives. 

Figure 3 is an image of the three-dimensional object to be encrypted obtained 
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by phase-shifting interferometry with the system in Figure 1 without a reference phase 
mask. 

Figure 4A is a gray-level representation of the encrypted amplitude of the 
object of Figure 3 by using a random phase mask. 

5 Figure 4B is a gray-level representation of the encrypted phase of the object of 

Figure 3 by using a random reference phase mask. 

Figure 5 A is a representation of the key amplitude of the random phase mask 
used to encrypt the information in Figure 4A. 

Figure 5B is a representation of the key phase of the random phase mask used 
10 to encrypt the information in Figure 4B. 

Figure 6A is the result of the decryption of the encrypted information 
contained in Figures 4A and 4B using the key in Figure 5. 

Figure 6B is the result of the incorrect decryption of the encrypted information 
in Figures 4A and 4B using a wrong phase key. 

1 5 Figure 7A is a first perspective of the three-dimensional object obtained after 

decryption at an angle of view of /3 ~ 0.7°. 

Figure 7B is a second perspective of the three-dimensional object after 
decryption at an angle of view of jS ~ 0°. 

Figure 7C is a third perspective of the three-dimensional object after 
20 decryption at an angle of view of jS ~ 0.7°. 

Figure 8 is a representation of the four step method of inducing a phase shift in 
the reference beam. 

Figure 9 is a schematic representation of a distributed computer network 
connected to the phase-shifting holographic system of Figure L 

25 Figure 1 0 is a second schematic diagram of a phase-shifting holographic 
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system for encrypting multi-dimensional information. 

Figure 1 1 is a third schematic diagram of a phase-shifting holographic system 
for encrypting multi-dimensional information. 

Figure 12 is a schematic diagram of a phase-shifting holographic system for 
5 recording and reconstructing a multidimensional object. 

Figure 13A is a first schematic representation of an optical reconstruction of 
an object from a hologram. 

Figure 13B is a second schematic representation of an optical reconstruction 
of an object from a hologram. 

10 Figure 14 is a schematic representation of a phase-shifting interferometer 

configured to perform Fourier encryption of an input object with two random phase 
masks; 

Figure 15A - 15C is a schematic representation of a method of encryption, 
obtaining a key and decryption of an object; 

15 

Figure 16 is a schematic representation of a phase shifting interferometer 
configured to perform Fresnel encryption of an input object; 

Figure 17 is a representation of information to be encrypted by Fourier 
20 transformation of the input obtained by digital phase-shifting interferometry of Figure 
14 without a reference phase mask; 

Figure 18A-18C is a representation of encrypted images of the input of Figure 
17 wherein Figure 18A is a gray level representation of the phase distribution 
25 obtained by phase shifting interferometry, Figure 18B is the amplitude distribution 
and 18C shows the reconstruction of the input object from the complex amplitude 
distribution associated with Figures 18A and 18C; 



UCT-0017 



7 



Figure 19A-19C is a representation of the key and decryption of Figure 17 
wherein Figure 19A is a gray level representation of the phase distribution of the key 
at the output plane obtained by phase-shifting interferometry, 19B is the amplitude 
distribution and 19C shows the reconstruction of the input object when the phase and 
5 the amplitude distribution in Figure 18A-18C are corrected with the key; 

Figure 20 is a representation of information to be encrypted by Fresnel 
propagation of the input signal obtained by digital phase-shifting interferometry with 
the optical system of Figure 16 without the reference phase mask; 

10 

Figure 21 A-21C is a representation of encrypted images of the information in 
Figure 20 obtained by phase-shifting interferometry with the system of Figure 16 
wherein Figure 21 A is a gray level representation of the phase distribution, Figure 
21B is the amplitude distribution and Figure 21 C shows an attempt to reconstruct the 
1 5 input object from the complex amplitude distribution associated with Figures 21 A and 
21B; and 

Figure 22A-22C is a representation of the key and decryption of the 
information in Figure 20 wherein Figure 22 A is a gray-level representation of the 
phase distribution of the key at the output plane, Figure 22B is the amplitude 
20 distribution of the key and Figure 22C shows the successful reconstruction of the 
input object when the phase and amplitude distribution in Figure 21 A-22c are 
corrected with the previous key. 

DETAILED DESCRIPTION OF THE INVENTION 

A system for encrypting multi-dimensional information or data is shown 
25 generally at 100 in Figure 1. The system 100 is based on an interferometer, such as a 
Mach-Zehnder interferometer. A first beam splitter 106 divides polarized and colli- 
mated light 102 originating from a laser, such as an Argon laser, a Helium-Neon laser 
an infrared laser or similar laser(not shown) embracing a range of wavelengths, into a 
reference beam (or reference set of data) 102a, 102aa and an object beam 102b, 102c 
30 102e. 
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With a first diaphragm 116 open, and a second diaphragm 118 closed, the 
object beam 102b, 102c illuminates a moving or still object, such as an opaque three- 
dimensional object 132 (to be encrypted), after reflecting in a second beam splitter 
1 14 and reflection at mirror 122. The object 132 may also be, for example, a two- 
5 dimensional or three-dimensional phase object, a color object, an original set of data 
comprising an optical image, a digitized image, a computer generated image, a one 
dimensional set of data or multi-dimensional set of data, an electrical signal or an 
optical signal. The object 132 is shown as a three-dimensional object by way of 
exemplification. 

10 Assuming that the incident light 102c is diffracted from the object 132 only 

once, the object 132 can be described at an output plane 130 as a three-dimensional 
continuum distribution of point sources with relative amplitude Uo(x,y,z), were x, and 
y are transverse coordinates and z is the paraxial distance from the object 132 to the 
output plane 130. In this manner, the complex amplitude distribution, Unfx.y), at the 

1 5 output plane 130, can be evaluated from the following three-dimensional 
superposition integral: 



20 where X is the wavelength of the incident light. In Eq. (1), A H (x,y) and <pn(^y) are the 
amplitude and phase, respectively, of the complex amplitude distribution, Un(x 7 y) y at 
the output plane 130 generated by the object beam 102e diffracted from the object 
132. In this approximation, neglecting secondary diffraction, the object 132 can be 
considered also as a continuum of two-dimensional images at different distances z to 

25 the output plane 130. 

The reference beam 102a travels through two phase retarders 108, 110 and is 
diffracted by a random phase mask 112. The light so diffracted 1 02aa is reflected by a 



U M {x,y) 



= A H (x,y)exv[i<f> H (x,y)] 



x - x'f +(y- y') 2 ]jdx'dy'dz 
0) 
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third beam splitter 126 and interferes, at 102f, with the light 102e diffracted by the 
three-dimensional object 132. The interference pattern of the object beam 102e and 
the diffracted reference beam 102aa is recorded as a hologram in the output plane 130 
of a detector 128, such as a CCD detector or an optically or electrically addressable 
5 spatial light modulator. The phase retarders 108, 110 are quarterwave (A74), and 
halfwave (A/2) plates. As seen in Figure 8 the phase retarders 108, 110 allow for the 
modulation or shifting of the phase, <p , of the reference beam 102a with respect to the 

object beam 102b. In this manner, phase shifts, Atp , of A<p i = 0, A(p 2 = 

A<p 3 = -7T, and A<p 4 = -3?r/2 are introduced into the reference beam 102a with 

10 respect to the object beam 102b by the relative positioning of the fast and slow axes of 
the phase retarders 108, 110 with the polarization of the incident light 102a. The 
aforesaid phase shifts, A<p p , may also be introduced into the reference beam 102a 

with respect to the object beam 102b by other methods or apparatus, such as the use 
of a liquid crystal chip in place of the phase retarders 108, 110 or by the movement of 
15 mirror 120. The phase mask 112, with a random phase distribution of 3>(x,y), and 
located at a distance L = Li + L 2 from the output plane 130 (Figure 1), generates a 
complex field, U R (x, y;A(p p ), for each of the aforesaid phase shifts, A(p p , given by 

the following Fresnel integral: 

U R (x 9 y; Aq> p ) = exp[/A^ ]exp 

oo 

JJexp[z^(je*,y)]exp 

—oo 

20 

(2) 

In Eq. 2 constant factors other than A(p p have been neglected. Equation (2) 
can be written in the form of a convolution as: 



i—(x 2 +y 2 ) 



i— (x ,2 +y 2 ) 

XL 



2k 

exp —i — (xx'+yy') dx'dy' 
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U R (x 9 y;A<p p ) = A R (x 9 y) exp[i(^ (x 9 y) + &<p p )J 
= exp(iA<p p )exp[zO<X >0] ® ex P 



i—{x 2 +y 2 ) 
XL 



(3) 

(J. W. Goodman, Introduction to Fourier Optics, McGraw-Hill, New York, (1996)). 

In Eq. 3, A R (x,y) and <p R (x,y) are the amplitude and phase, respectively, of the 
5 complex amplitude distribution, U R (x 9 y;A<p p ) at the output plane 130 generated by 
the reference beam 102a when both fast axes of the phase retarders 108, 110 are 
aligned with the direction of polarization, i.e., when A(p p =0. Since ®(x,y) is a 
random phase distribution, from Eq. (3) it may be concluded that A R (x,y) and <p R (x f y) 
are random, noise-like functions. 

10 The interference pattern, I p (x 9 y) , of the combination of U H (x,y) and 

U R (x 9 y;A<p p ) is recorded digitally, or on film, as a hologram at the output plane 

130. Such digital recording may be in the form, for example, of tangible media, such 
as floppy diskettes, CD-ROMs, hard drives, electrically or optically addressable 
spatial light modulators, charge coupled devices or any other computer-readable 
15 storage medium addressable across a distributed environment such as a computer or 
communications network system. I p (x 9 y) is given by the coherent superposition of 

Eqs. (1) and (3), i.e. 



I p (x 9 y) = [A H (x 9 y)Y +[A R (x,yj\ 2 + 

2A H {x 9 y)A R (x 9 y) cos[^ (x 9 y) - q> R (x 9 y)-A<p p ] 



(4) 



Recording four interference patterns, I p (x,y), (or holograms) with the phase of 
20 the reference beam 102a shifted by A(p p , it is possible to obtain the encrypted phase 
and encrypted amplitude of the object 132. From Eq. (4) it is straightforward to show 
that the encrypted phase, <j) E (x 9 y) , of the hologram is given by: 
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fa ( x >y) = fa (*>y) - <p R ( x >y) = arctan 



(5) 



The encrypted amplitude, A E (x 9 y) , of the hologram can be calculated from the 
following equation: 

A E (x,y) = A H (x,y)A R (x,y) = ±[(I 1 - 7 3 ) 2 + (7 4 - I 2 f}' 2 (6) 

5 For simplicity, the spatial dependence of I p (pc,y) has been omitted from Eqs. (5) and 
(6). The two functions given by Eqs. (5) and (6), i.e., the amplitude A E (x,y) and the 
phase <f> E (x ? y) , constitute the encrypted image. Without knowledge of the functions 

A R {x,y) and <p R {x,y)> which act as keys for decryption, it is very difficult to recover 
the amplitude Ajfe,y) and phase <pn(x,y) in order to reconstruct images of the three- 

10 dimensional object 132 by inverse Fresnel propagation. Alternatively, the random 

phase mask 112 and its three-dimensional position can also act as the key. In contrast 
with other phase encryption methods, not only the phase, but also the amplitude, of 
the diffraction pattern of the object 132 is modified by the introduction of the random 
phase mask 112 into the reference beam 102a. Furthermore, instead of a Fraunhofer 

15 diffraction pattern, a Fresnel diffraction pattern of the object 132 is used for 

encryption. Therefore, phase retrieval algorithms are difficult to apply. Still further, 
by dealing with Fresnel diffraction patterns, the intensity of the output images is 
properly adapted to the dynamic range of the CCD 128. As seen in Figure 10, it is 
also possible to effect encryption of the object 132 by utilizing a random phase mask 

20 112a located a distance L 3 from the output plane 130 within the object beam 102e and 
without the random phase mask 1 12 in the reference beam 102a. In addition, it will 
be appreciated that the random phase masks 112a, 112 of Figures 1 and 10 may be 
utilized in combination to accomplish encryption of the object 132 as shown in Figure 
11 . This improves security, as the number of keys is increased, but it would be 

25 necessary to perform two Fresnel propagation steps to reconstruct the object 132. The 
following are incorporated herein by reference in their entirety: P. Refregier and B. 
Javidi, Optical Image Encryption Using Input and Fourier Plane Random Phase 
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Encoding, Journal of Optics Letters, vol. 20, pp. 767-769, April 1, 1995; B. Javidi, 
Encrypting Information with Optical Technologies, Physics Today, vol. 50, no. 3, 
March 1997; N. Towghi, B. Javidi, and Z. Luo, Fully Phase Encrypted Image 
Processor, Journal of the Optical Society of America A (Optics, Image Science and 
5 Vision), Vol 16, No. 8, pp. 1915-1927 (Aug. 1999). 

To obtain the functions that can be used as keys for decrypting the encrypted 
information (or set of data), diaphragm D3 is open, diaphragm D2 closed and the 
object 132 is removed from the interferometer 100. Item 124 is a mirror. Now the 
reference beam 102aa and the object beam 102d interfere in-line at the output plane 
10 1 30. hi this way, a second set of four intensity patterns, / ' p (x,y% are recorded by 

adjusting or shifting the phase of the reference beam 102a as before. Now, the phase 
key, <j) K (x,y) , for decrypting the encrypted object (or set of data) is calculated from: 



(f) K (x, y) = # c - (p R (*, y) = arctan 



J 4 J 2 

K 1 I 1 3 J 



(7) 



and the amplitude key, A K (x 9 y) , for decrypting the encrypted object, is calculated 
1 5 from: 

A K (x,y) = A c A R (x,y) = ±[(I\-I\ f + f]' 2 (8) 

The parameters^ and^4 c are respectively, the constant phase and amplitude of the 

object beam 102d and can be replaced with constant values, such as 0 and 1 
respectively. 

20 In a first embodiment decryption is performed by combining A E (x ? y) 

and (j> E (x 9 y) with A K (x, y) and <j) K (x, y) in the following way: 

<I>d 0> y) = fa 0> y) - <f>K (*> y) ( 9 ) 

and 



UCT-0017 



13 



A K (x,y) 



A D (x,y) = < 



, if A K (x,y)* 0 



otherwise 



(10) 



In a second embodiment, decryption can be performed directly form the 
intensity measurements in the following manner: 



(j) D (x, y) = arctan 



(7 4 -/ 2 )(/' 1 -/'3)-(7 1 -7 3 )(/' 4 -/' 2 ) 
(7 4 -/ 2 )(/' 4 -/' 2 -/3XA-/3 ) 



(11) 



and 



(7 1 -7 3 ) 2 +(7 4 -7 2 ) 2 
(/• I _/' 3 ) 2 +(/' 4 -/' 2 ) 2 



1/2 



(12) 



In Eqns. 1 1 and 12, the two functions Iw(x,y) ~ I\(x,y) ~ h(x,y) and hi(x,y) = h{x,y) - 
h(x,y) constitute the encrypted information, while the functions / = / \(x,y) - 

T$(x,y) and / Ui&y) = I \{x,y) - / *i(x,y) act as the decryption key. 

1 0 The functions A D (x 9 y) and (j> D (x, y) constitute the amplitude and phase of the 

decrypted Fresnel hologram which is given by U D (x,y) = A D (x 9 y ) exp[z (j> D (x, y) ] . 

Except for constant factors, Uj^x,y) reproduces the Fresnel hologram, Ug(x,y) 9 of the 
three-dimensional object 132 as set forth in Eqn. (1). Thus, by the free-space 
propagation of U D (x,y), the amplitude distribution of the object 132 can be 
15 reconstructed. 

La Figure 13 A, the reconstruction of the object from encrypted or unencrypted 
holograms may be performed optically rather than digitally. An electrically 
addressable spatial light modulator 220a is interfaced with the detector 128. The 
digital holograms 224a are displayed on the electrically addressable spatial light 
20 modulator 220a. The encrypted or unencrypted hologram 224a is propagated by a 
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reference wave 102g. The encrypted hologram is passed through an optical key 222 
to reconstruct the original object 132a in a reconstruction plane 130a. The optical key 
222 is not necessary for the unencrypted hologram. In Figure 13B, the encrypted or 
unencrypted hologram 224b, such as an off-axis hologram, is formed by an optically 

5 addressable spatial light modulator 220b such as a liquid crystal light valve or Ferro- 
electric spatial light modulator. The encrypted or unencrypted hologram 224b is read 
out from the output of the optically addressable spatial light modulator 220b and 
propagated by a reference wave 102g. The encrypted hologram is passed through an 
optical key 222 to reconstruct the original object 132a in a reconstruction plane 130a. 

1 0 The optical key 222 is not necessary for the unencrypted hologram. As best 

understood from Figures 13 A and 13B the optical key 222 may be in substantially the 
same plane as the spatial light modulators 220a, 220b and is shown separated for 
clarity. The following are incorporated herein by reference B. Javidi and J .L. Horner, 
Real-time Optical Information Processing, Academic Press, 1994, B. Javidi, Optical 

1 5 Information Processing, Encyclopedia of Electrical and Electronic Engineering, 
Volume on Optics, John Wiley, 1999. 

Digital reconstruction of the object 132 is performed by numerically 
computing a Fresnel integral. Let U D (m,n) be the discrete amplitude distribution of a 
decrypted digital hologram, where m and n are discrete coordinates in the plane of the 

20 digital hologram, along the orthogonal directions x and y, respectively. In this way, 
x=mAx and y=ntsy, where Ax and Ay are the resolution of the detector. The discrete 
complex amplitude distribution, U 0 (m',n'), of the reconstructed object, located at a 
plane orthogonal to the decrypted digital hologram, and at a distance d from the 
decrypted digital hologram, is given, aside from constant factors, by the following 

25 discrete Fresnel transformation: 
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U 0 (m\n') = exp 



x exp 



™{Ax*m*+Ay*ri 2 ) 
(Ax 2 m 2 +AyV) 



Ad 



Y.i:U D (m,n) 

m'=0 n=0 



Ad 



exp 



f r i ^\ 

mm n « 



(13) 

In Eq. (13), m ! and «■ are discrete coordinates in the reconstruction plane, Ax' 
and Ay denote the resolution in that plane, and N x and N y are the number of pixels of 
the detector along the x and y axis, respectively. It can be shown that the resolutions 
Ax' and Ay' along the horizontal and vertical directions of the reconstruction plane are 
given by: 



10 



Ax'= ^ , and 
N x Ax 

(14) 

Ad 

Ay = 

NAy 



In this manner, the resolution of the image of the reconstructed object improves as the 
number of samples in the hologram plane increases. 

Referring now to Figure 2 5 a decrypted digital hologram is shown at 206. 
Different regions, or windows, of the decrypted digital hologram 206 record light 

15 arising from different perspectives, views or segments of the three-dimensional object 
132. Thus, different perspectives, views, or segments, of the three-dimensional object 
132 can be reconstructed by defining different windows 206a within the decrypted 
digital hologram 206 and illuminating the windows 206a with plane waves tilted at an 
angle of j8 with respect to the optical axis 202. To this end, assume that the input 

20 object 132 to be encrypted is located at a distance d from the CCD 128. To 
reconstruct a particular view of the decrypted three-dimensional object 132, a 
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rectangular window 206a (or subset) is defined within the decrypted digital hologram 
206 and centered at the location, a^ay. The information contained within this window 
206a corresponds to a particular direction of observation 208 that subtends angles a 
and P with respect to the optical axis 202. These angles are given by: 



a-— — , and 
d 

a Ay 
JB= y y 



(15) 



d 

In Figure 2, a x equals zero. 

The decrypted digital hologram 206 is illuminated by a light beam directed 
towards the window 206a at angles a and P with respect to the optical axis 202 as 
given by Eq. (15). In this manner, the perspective of the object 132 will remain 
10 centered in the reconstruction of the object 132. The angular range achieved will be 
limited only by the size of the detector. 

From the above considerations, a partial discrete amplitude distribution, 
U ' D (rn,n;a x ,eLy), is defined over the window 206a within the decrypted digital hologram 
206, and is used for reconstructing a segment of the object 132. The partial discrete 
1 5 amplitude distribution is given by: 



V\ (m, n;a x ,a y )~ U D (m, ri)rect 



f \ 
m - a . n - a , 



V b * b y J 



Qxp\i27t(a x m + a y n)] 
(16) 



where rect{g,h) is the so called rectangle function and h x and by denote the transverse 
size of the window 206a. The linear phase factor in Eq. (16) simulates the effect of a 
20 tilted plane wave incident upon the decrypted digital hologram 206. Now, the discrete 
complex amplitude distribution, U } 0 (m\n'\a,fi), of a particular perspective, view or 
segment of the reconstructed object at a plane located at a distance d from the 
decrypted digital hologram 206 and tilted by angles a and P with respect to the optical 
axis 202 can be computed using the following equation: 
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U' 0 (m\n';a,/3) = exp 



x exp 



M 

- in 



i7V (Ax' 2 m a +Ay 2 n a ) 
(Ax 2 m 2 + Ay 2 n 2 ) exp 



m'=0 «'=0 



1^ Ax Ay 



M 



( . . Y 

- /2/r -l 



(17) 

The introduction of the linear phase factor in Eq. (16) is equivalent to a tilted plane 
5 wave illuminating the hologram in Eq. (17), 

The geometry of the configuration for the particular case of a vertical variation 
in the perspective of the object (e.g., restricted to a x = 0) is depicted in Figure 2. The 
maximum angle of view, p max > is a function of the CCD size and the window size, 
fimsoc^iNy-byJAy/d. This range in p can be increased by increasing the size of the CCD 

10 or by decreasing the size of the window used for reconstruction. However, as pointed 
out in Eq. (14), the resolution of the reconstructed object decreases by selecting 
smaller windows. Nevertheless, the hologram window 206a does not need to be 
square. Therefore, when a set of perspectives is obtained in only one direction, it is 
possible to improve the resolution of the object reconstruction by increasing the size 

15 of the hologram window 206a in the transverse direction, as is shown in Figure 2. 

Equation (17) can be efficiently computed using a fast Fourier transform 
algorithm (J.W. Cooley, J,W., Tukey, "An Algorithm For The Machine Calculation Of 
Complex Fourier Series," Math. Comput. 19, 297-301 (1965) which is incorporated 
herein by reference). Thus, different perspectives can be generated at high speed. 
20 Points on the surface of the object 132 at distances z from the hologram where z ^ d 
will appear defocused in the image of the reconstructed object. Nevertheless, the 
planes of reconstruction can also be changed easily in the computer starting from the 
same digital hologram. The field of focus can be increased by diminishing the size of 
the hologram window 206a at the expense of a reduction in resolution. 

25 Encryption of a three-dimensional object was performed with the phase- 
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shifting interferometer 100 depicted in Figure 1. A mega-pixel camera 128 with pixel 
size equal to 9x9 (im was used to record the interference patterns between the object 
beam 102c, 102e and the reference beam 102aa with a dynamic range equivalent to 
256 grey levels. The object 132 was the shape of a cube of about 10 mm lateral size. 
5 In Figure 3 an axial view of the object 132 reconstructed from a non-encrypted digital 
hologram using Eq. (13) is shown. The object 132 was located at a distance of d 
equal to about 570 mm from the camera 128 and without a phase mask in the 
reference beam 102a. Diaphragm D2 was open and diaphragm D3 was closed in 
order to illuminate the three-dimensional object 132. The resolution of the re- 

1 0 constructed image was limited by the size of the camera 128, which acts as an 

aperture in the reconstruction process, as is shown in Eq. (14). The quality of the 
image is also affected by speckle. The speckle size is, roughly speaking, equal to 1.2 
WNA, where NA is the numerical aperture of the system. Thus, the size of the speckle 
is approximately equal to the resolution of the image of the reconstructed object given 

15 byEq. (14). 

Figure 4A is a gray-level representation of the encrypted amplitude of the 
object computed from Eqn. (6) using a random phase mask as in Figure 1 . Figure 4B 
is a gray-level representation of the encrypted phase of the object computed from Eqn. 
(5) using a random phase mask as in Figure 1 . The random phase mask 112 was a 
20 plastic diffuser of randomly varying thickness with a correlation length of about 6 /xm 
in both the x a&dy directions. 

Figure 5 A is a gray-level representation of the amplitude key used to decrypt 
the information in Figure 4A. Figure 5B is a representation of the phase key used to 
decrypt the information in Figure 4B. The amplitude and phase keys of Figures 5 A 

25 and 5B were generated at the output plane 130 utilizing the random phase mask 1 12 
and by removing the object 132, closing diaphragm D2 and opening diaphragm D3. 
From the encrypted and key interference patterns the decrypted hologram is obtained 
by using Eqs, (9) and (10) or Eqs. (1 1) and (12). The decrypted image shown in 
Figure 6A was generated using the entire decrypted hologram. By way of 

30 comparison, Figure 6B shows a decryption performed without the correct keys. Noise 
in the image of the decrypted object arises from errors, generated by the random 
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phase mask 1 12, in the evaluation of the Fresnel diffraction pattern in the CCD. 
These errors are due to the limited size of the detector pixels and the grey-level 
quantization. 

Figure 7 shows different perspectives of the decrypted three-dimensional object 
5 132 reconstructed from the decrypted digital Fresnel hologram 206. A rectangular 
window 206a was used limited to a vertical size, by, of 256 pixels and horizontal size, 
b x> equal to the size of the CCD. The size reduction is used to reconstruct different 
perspectives from different regions 206a of the decrypted digital hologram 206. 
However, this also reduces the resolution and, consequently, the quality of the images 

10 with respect to those obtained using the whole decrypted digital hologram 206. Thus, 
only the size of the window 206a in the direction for which different views of the 
three-dimensional object 132 are need is reduced (e.g. in the y direction in the 
example of Figure 2). In this embodiment, the window 206a was displaced only in 
the vertical direction generating an angular difference of about 0.7 degrees between 

1 5 the different perspectives shown in Figures 7 A, 7B and 7C. Any other view angle, 
limited only by the size of the CCD, can be reconstructed in the same way. 

Referring to Figure 9, the detector 128 is shown connected to a distributed 
computer or communications network 400, such as a local area network (LAN) or a 
wide area network (WAN) via a computer 402. The detector 128 may also be 

20 connected directly to a liquid crystal display (LCD), liquid crystal television (LCTV) 
or an electrically or optically addressable spatial light modulator or ferroelectric 
spatial light modulator 412a. The computer network 400 includes a plurality of 
similar client personal computers 404 connected to a server 410 from remote 
geographical locations by wired or wireless connections, by radio based 

25 communications, by telephony based communications, or by other network-based 
communications. The computer 402 may also be connected directly to another like 
computer 402 or to a display device 412, such as a liquid crystal display (LCD), liquid 
crystal television (LCTV) or an electrically, or optically addressable spatial light 
modulator (SLM) for optical reconstruction of the 3D object 132 or set of data. The 

30 computer network 400 is in turn similarly connected to other computers 502 or 

networks 504 through the Internet 500, The computers 402, 404, 504, display devices 

20 
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412, 412a and other devices of the networks 400 ? 500, 504 are configured to execute 
program software, that allows them to send, receive, record, store and process the 
encrypted and decrypted holograms, the encrypted sets of data, decryption keys and 
decrypted sets of data between and amongst themselves via the networks 400, 504 
5 and the Internet 500. Such processing includes, for example, various image 

compression and decompression, filtering, contrast enhancement, image sharpening, 
noise removal and correlation for image classification. Decompressed images may be 
displayed on display devices such as liquid crystal displays, liquid crystal TVs or 
electrically or optically addressable spatial light modulators. This embodiment has 

10 applications in the serial three dimensional imaging of moving objects, such as in 
three dimensional TV, three dimensional video, three dimensional movies as well as 
three dimensional display and three dimensional visualization and other similar 
applications. Thus serial images may be formed of moving objects by forming a series 
of original encrypted holograms of the moving objects; compressing the series of 

15 original encrypted holograms of the moving objects to form a series of compressed 
encrypted holograms; decompressing the series of compressed encrypted holograms 
to form a series of decompressed encrypted holograms; and reconstructing the moving 
objects from the series of decompressed encrypted holograms to form a series of 
multi -dimensional images of the moving objects. 

20 Thus, based upon the foregoing description, an optoelectronic holographic 

method and system for encrypting and decrypting multi-dimensional information or 
data, based upon phase-shifting interferometry, has been shown. Such method allows 
for the securing of three-dimensional scenes or data. The holographically encrypted 
data can be transmitted through conventional digital communication channels to 

25 remote locations and the data decrypted and reconstructed digitally or optically. 
Different views or segments of the decrypted three-dimensional object can be 
reconstructed at different axial distances and at different perspectives. Since an 
optical system is utilized to record the digital hologram, optical encryption with a 
random phase mask represents a convenient way to secure both two and three- 

30 dimensional objects or information. Furthermore, in this manner, to increase security, 
the method allows for the avoidance of electronic transmission of decryption keys if 
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so desired. Still further, other electronic encryption methods can also be applied to 
the digital hologram. In the methods of this invention, after electronic transmission of 
the encrypted information or data, decryption is carried out digitally or optically. 
Alternatively, decryption can be performed optically by generating the decrypted 
5 digital hologram as a computer generated hologram and displaying it, for example, on 
an electrically addressable spatial light modulator, liquid crystal television or liquid 
crystal display. 

In accordance with a second embodiment of the invention, an optical 
encryption method based upon digital phase-shifting interferometry may be used to 

10 record the fully complex encrypted information. Fourier and Fresnel domain optical 
encryption is achieved by the use of one or more random phase masks attached to the 
input in the object beam and another phase mask at a variable position in the reference 
beam of a Mach-Zehnder phase-shifting interferometer. The fully complex key to be 
used in the decryption process is also obtained by phase-shifting interferometry. The 

15 encrypted information can easily be transmitted over digital communication lines, and 
the key can be transmitted either electronically or by means of making controlled 
copies of the reference phase mask used in the encryption procedure. The decryption 
can thus be performed either electronically or optoelectronically. 

The encryption is performed immediately and directly on the fully complex 
20 information and that the decryption procedure, if performed electronically, requires no 
more computation than the usual image reconstruction procedures. Therefore the 
potential for a significant speed advantage over fully digital encryption techniques is 
quite apparent. After decryption, electronic reconstruction with a one-step fast 
Fourier transform (FFT) procedure or optical reconstruction methods can be applied. 
25 With optical decryption, the correct phase key must be positioned in three- 
dimensional space to successfully decrypt the data. 

In Figure 14, in an interferometer 100, such as a Mach-Zehnder 
interferometer, an argon laser beam 102, is expanded 146, collimated 148, and 
divided by a beam splitter 106 into two plane wave fronts traveling in different 
30 directions. These are the object beam 102b and the reference beam 102a. After 
reflecting in a mirror 124, the object beam 102b impinges on a multi-dimensional 
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input object or transparency 132, whose amplitude transmittance, t(x,y), contains the 
data to be encrypted. A refractive lens 140 forms a representation of the Fourier 
transform of the input into the output plane 130 of a CCD detector 128 through the 
second beam splitter 126. The detector is connected to a distributed computer or 
5 communications network 400 as in Figure 9. To improve the dynamic range of the 
Fourier transform in the output plane 130, and to make it more difficult to obtain the 
power spectra of the input object 132, a random phase mask 132a, with phase §\ (x,y) 
is attached to the input object 132. Therefore, aside from constant factors, the 
complex amplitude distribution, Uo (x,y), of the Fraunhofer diffraction pattern at the 
10 output plane 130 is approximated by: 



where d is the distance between the input and the refractive lens, /is the focal length 
of the lens, and X is the wavelength of the laser beam 1 02. Aside from the phase 

15 factor outside the integral, the complex amplitude distribution is the Fourier transform 
of the product of the input transmittance and the input phase mask. A Fourier 
transformation is obtained when d =f. By measuring the amplitude and the phase of, 
Uo(x,y), we can recover the amplitude of the input function t(x,y) } from the inverse 
Fourier transform intensity. 

20 The parallel reference beam passes though two phase retarders 108, 110, one 

quarter and one half wave plate; is reflected by a mirror 120; and is modified by a 
second random phase mask 1 12. The system is aligned such that, without the phase 
mask 112, the reference beam 102a generates a plane wave 102f traveling 
perpendicular to the CCD 128 sensor after reflecting in the second beam splitter 126. 

25 The light provided by the argon laser 142 is linearly polarized. In this way, by 

suitable orientation of the phase retarders 108, 110, the phase of the reference beam 




xllt(x',y)exp[i^,y)] 



—OO 



xexp-z — (xc'+j/y') dx'dy' (18) 
L 
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102a can be changed, as shown in Figures 8A -8D. Assume that the phase of the 
parallel beam 102a after the second plate 1 10 is <j> 0 when the fast axes of both plates 
108, 110 are aligned with the direction of polarization of the incident light 102a. By 
successively aligning the different slow and fast axes of the phase retarders 108, 110 
5 with the direction of the polarization, phase values 0 O + a with a = -7r/2, - % and -3 7r/2 
can be produced with high accuracy, as shown in Figures 8A - 8D. 

The reference phase mask 112 has a random phase distribution ^%(x t y) and is 
placed at a distance z - zj + from the CCD 128, as shown in Figure 14. The 
complex amplitude distribution of the reference beam as in the output plane 130 can 
10 be calculated by use of the Fresnel-Kirchhoff integral with the following expression 



where a denotes the relative phase changes introduced by the retarder plates 108, 110 
15 on the reference beam 102a. Constant phase factors are omitted in Eqn. 19. 

The intensity pattern recorded by a linear intensity recording device, such as a 
CCD camera 128, is then given by 



with Uq and U R given by Equations 18 and 19, respectively. Since Eqn. 19 provides a 
random-noise-like phase and amplitude distribution, the image provided by the CCD 
128 will also look like a random intensity distribution. 

The complex light field at the output plane 130 can be evaluated with digital 
25 phase-shifting interferometry when four intensity patterns are recorded with the 

reference beam 102a phase shifted by a — 0, 7r/2, 7r and 3^/2. The phase shifting is 




x \ Jexp[*V 2 (x\j/)]exp i— (x ,2 +/ 2 ) 



xexp -i — (xx'+yy') dx'dy' 



(19) 



I(x,y;a) = \U 0 (x,y) + U R (x,y;af (20) 
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accomplished by suitable orientation of the retarder plates 108, 1 10 located in the path 
of the reference beam 102a (see Fig. 8 A - 8D). Denoting the complex amplitude 
distribution of the object 132 and the reference beams 102a at the output plane 130 
with U 0 = Ao(jy>)exp[i<KAy/)] and U R = A K (x,y)exp{i[cj>(x,y)+a]} respectively, Eqn. 20 
can be rewritten as 



I(x,y;a) = [A o (x,y)] 2 + [A R (x,y)] 2 + 2A(x,y) 
x A R (x,y)cos[0 o (x,y) - <p(x,y) - a] 



(21) 



In this way it can be shown that the phase $e(x,}>) provided by this phase- 
shifting interferometric technique is given by 
<f> E (x, y) = (f> 0 (x, y) - <p(x, y) 

I(x,yr*y 2 )-I{x,yr*/ 2 ) 



arctan 



I{x,y;0)-I{x,y-7c) 



(22) 



The amplitude, A E (x,y\ can be calculated from the following equation: 



A Ax ,y) = Mx,y)A s (x,y) = \ /( ^ ) ~ (23) 

4cos[^(x ? ^)-^(x ? j;)J 

where the argument of the cosine function in the denominator is obtained directly 
from Eq. 22. 

It is difficult to recover the complex amplitude distribution, U 0 (x, y), 
generated by the object beam 1 02b. Since <f>(x,y) and A R (x,y) are random functions, 
the phase $ 0 (x, y) and the amplitude, A Q {x,y) can not be obtained from Eqns. 22 and 
23, respectively. Thus, it is difficult to obtain the input function, t(x, y), by an inverse 
Fourier transformation. The input data are encrypted such that they can be decrypted 
only with knowledge of the reference complex amplitude distribution U R (x, y;0) or the 
reference phase mask $ 2 (x, y) and its three-dimensional position, which is acting as a 
key. The phase and the amplitude given by Eqns. 22 and 23, respectively, can be 
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simply understood as the phase and the amplitude of the product of the Fourier 
complex amplitude, Uo(x, y) 9 with a second random complex amplitude distribution, 
which is the complex conjugate of Ur(x, y;0). When the reference phase mask 1 12 is 
imaged over the output detector 128 instead of using Fresnel propagation, the 
5 encrypted image is that which is achieved by the double phase method. However, 
with this new technique we improve on the security extending the encryption to the 
Fresnel domain, and we can store, process and transmit the encrypted information 
easily without the help of holographic recording media. In Figure 15 A, a diagram of 
the encryption procedure is shown. 

10 To decrypt the information and obtain the original complex amplitude 

distribution Uo(x, y) 9 we also use the phase-shifting interferometry technique to 
achieve the key complex distribution Ur(x, y;0). By removing the input transparency 
132, the input phase mask 132a, and the Fourier transforming lens 140 in the optical 
system 100 in Figure 14, the phase and the amplitude of the Fresnel diffraction pattern 

1 5 generated by the reference phase mask 112 can be measured. In this case, the 
intensity at the output plane 130 is given by: 



20 where Ac and (j)c are the constant amplitude and phase, respectively, of the object 
beam at the output plane. The phase, (J>k(x, y), and the amplitude, Agfa, y) 9 provided 
by the phase-shifting interferometry technique are now 



P(x,y;a) = \A c exp(i<p c ) + U R {x,y;a)\ 



(24) 



I\x,y-3nl2)-I\x,y-7i/2) 
r(x,y;0)-r(x,y;-x) 



(25) 



25 



4- K (x,y) = A c A R (x,y) = 



1 l(x,y;0) - I(x,y;-n) 



(26) 



4 cos[^ o -<p(x,y)] 



respectively. 
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V 



Parameters ^ c and A c in Eqs. 25 and 26 are only constant factors and thus 
can be simply substituted by 0 and 1, respectively. Thus Eqs. 25 and 26 allow us to 
obtain directly the key functions <tfx, y) andA R (x, y). The complex amplitude 
distribution U 0 (x, y) can be obtained when we combine Eqs. 25 and 26 with Eqs. 22 
and 23 in the following way: 



(t> 0 (x, y) = <f> E (x, y) - </> K (x, y) 



(27) 



10 



15 



A F (x,y) 



, ifA K (x,y)*0 



otherwise 



(28) 



20 



A diagram of the procedure for obtaining the key is shown in Figure 15B. By 
proper propagation of the previously obtained complex amplitude distribution, Uo(x, 
y) 9 with the Fresnel-Kirchhoff integral, it is possible to obtain the intensity distribution 
in any other plane of the incident light beam within the paraxial approximation. In 
particular, the input object intensity can be recovered by an inverse Fourier 
transformation. Figure 15C corresponds to the diagram of the decryption procedure. 
The reconstruction can be implemented both optical and digitally. For the direct 
computer reconstruction we perform the following inverse discrete Fourier 
transformation of the complex amplitude distribution characterized by Eqs. 27 and 28, 
i.e., 



\t(m,n)\ 2 = 



iV-l ^-1 



XX£/ o (m>')exp 



. . . 

i — (mm +nn ) 

N 



(29) 



where ni and are the discrete spatial coordinates in the CCD plane 130 and m, n are 
25 those corresponding to the object plane. If we consider only the horizontal transversal 
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direction, we have x 1 = m 1 Ax' = mAx', with Ax' and Ax as the spatial resolutions in the 
CCD plane 130 and the input plane 132, 132a respectively. In Eq. 29 we assume that 
the number of pixels in both orthogonal directions of the CCD 128 is the same, 
denoted by N. Extension to different number of pixels is straightforward. Eqn. 29 can 
5 be calculated through a FFT algorithm. 

The resolution of the technique can be evaluated taking into account the 
physical size of the CCD 128 and the configuration of optical system 100. The scale 
factor of the optical Fourier transform operation performed by the system in Figure 14 
is xVu — y, where u is the spatial frequency in the horizontal direction. However, it 
10 can be shown that the scale factor of the computer Fourier transformation in Eqn. 29 
is xVu = N Ax' Ax. By comparing both equations, we have the following resolution in 
the input plane 132, 132a, 



15 



NAx' T 



where T ' is the transversal size of the CCD 128. We can improve on the resolution 
by using a shorter wavelength, a longer focal length of the Fourier transforming lens 
140, or by increasing the size of the CCD 128. 

An optical reconstruction will also be possible by simple coding of the phase 

20 and the amplitude given by Eqs. 27 and 28, respectively, into two LCD's configured 
to work in only phase and amplitude, respectively, and by means of performing an 
optical Fourier transform with a single lens. 

The Fourier encryption can be modified in different ways when we change the 
optical setup in Figure 14. For example, the reference random phase mask 112 can 

25 either be imaged or Fourier transformed at the output plane 130 instead of free-space 
propagated. The optical transformation applied to the object beam 102b can also be 
similarly modified. This section explains how to modify the previous system into a 
lensless architecture. This modification allows for a more compact and versatile 
optical system and improves the security. Now, to decrypt the information, it is 

30 necessary to know the position of the input object 132 and the wavelength, X, of the 
light beam 102b. 
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The optical configuration is depicted in Figure 16. The object beam 102b is 
still incident on the input transparency 132, with the input phase mask 132a bonded, 
but the diffracted light travels by free-space propagation directly to the CCD camera 
128. In the situation the complex amplitude distribution that is due to the object beam 
5 102b over the CCD 128 can be evaluated from the following expression: 



10 



15 



20 



25 



U 0 (x,y) = exp 



exp 



*— (* a +/) 

i— (x"+? 2 ) 



dx'dy' 



exp 



-i— (xx'+yy") 
Id n } 



(31) 



By use of phase-shifting interferometry, Eqs. 22 and 23 provide the encrypted 
phase and amplitude of the input signal. Both images will look like random 
distributions, owing to the action of the input and the reference phase masks, The key 
images are obtained as well from Eqs. 25 and 26 by phase-shifting interferometry 
after removal of the input function 132 and the input phase mask 132a from the 
optical system 100, With only these key images it is possible to decrypt the stored 
information by use of Eqs. 27 and 28. 

Again, the reconstruction of the encrypted information, t(x, y) 9 can be 
implemented both optically or by computer. In this case we need information not 
only about the location of the input image 132 in the optical path of the interferometer 
100 but also about the wavelength of the incident light and the pixel size of the CCD 
128. Then, the computer reconstruction can be performed by applying an inverse 
discrete Fresnel transformation to simulate the free-space propagation. Thus the input 
information can be retrieved from the following equation, 



\t(m,n)\ = 



in— (m' 2 +n' 2 ) 



exp 



i^-(mm'+nn') 
N } 



(32) 
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where it is assumed that the size of the pixels in both transversal directions is the 
same, denoted by Ax ! and d = -d. The evaluation of the Eq. 32 can be performed in 
the computer in a short time by use of FFT algorithm. 

Now the resolution of the reconstruction depends on the distance d. By 
5 applying a reasoning similar to that in the Fourier encryption, it can be proved that the 
resolution is given by Eq. 30 but substituting/ with d. Thus the resolution can be 
improved again by selection of a shorter wavelength, when the size of the CCD 128 is 
increased or the distance d is decreased. The Fresnel approximation is Eq. 31 restricts 
the possible values of d. There is also another limit imposed by the spatial 

1 0 quantization of the quadratic phase factor in Eq. 32. In this way the distance d must 
be kept greater than Ax' 2 /XN to obtain a proper sampling of the phase factor. 

The optical system 100 in Figure 14 was experimentally constructed in to 
verify the performance of our approach. An argon laser 142 was used emitting a 
vertical polarized light beam with X= 514.5 nm. The retarder plates 108, 1 10 were 

1 5 half and quarter- wave plates optimized for the preceding wavelength. They were 
previously calibrated to find the directions of the fast and the slow axes. The four- 
step phase shifting was performed manually. However, other phase-shifting methods 
can be used to optically encrypt data in real time. For example, it is common to shift 
the mirror 120 of the reference beam 102a with a piezoelectric translator to obtain 

20 high-speed phase shifting. 

The Fourier transform lens 140 in the object beam 102b had an approximate 
focal length/ = 200 mm and an approximate numerical aperture of 0.1. The input 
object 132, with the input phase mask 132a bonded, was located at a distance / from 
the Fourier transform lens 140. The input information 132 was encoded as a binary 

25 image in a black-and-white transparency. The reference phase mask 1 12 was located 
at an approximate distance z = 300 mm from the CCD plane 130. The phase mask 
1 12 is commercially available plastic diffuser of randomly varying thickness with a 
correlation length of 6 mm in both the x mAy directions. The different 
interfero grams were registered by a CCD camera 128, sampled with 480 x 480 pixels 

30 and quantized to 8 bits of gray level with a frame grabber. The size of the pixels in 
the camera 128 were measured to be Ax 1 Ay = 10 fim x 10 fim, 
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Figure 17 shows a computer-reconstructed image of the input to be encrypted. 
It was obtained by phase-shifting interferometry without use of the reference phase 
mask. Once the phase and the amplitude at the CCD plane 130 were obtained, an 
inverse FFT algorithm was applied to recover the input image. The noise in the image 
5 is due to the limited space-bandwidth of the optical system 100. The encrypted phase 
and amplitude distributions after location of the reference phase mask 1 12 as 
indicated in Figure 14 are shown in Figures 18A and 18B, respectively, as gray-level 
pictures. By inverse Fourier transformation of the complex amplitude distribution 
associated with these images, the picture in Figure 18C is obtained. We are able to 

10 obtain only a random-like intensity pattern. 

To decrypt the previous information the key phase and amplitude functions are 
measured by using Eqs. 25 and 26. These distributions are shown in Figures 19A and 
19B as gray-level pictures. By correcting the images in Figures 18A and 18B with the 
key, as is stated in Eqs. 27 and 28, we are able to reconstruct the original image by 

1 5 inverse Fourier transform in a computer 402. The decrypted image is shown in Figure 
19C. The experimental results prove the feasibility of the proposed technique. 

Figures 20-22C show the results obtained in the encryption experiment with 
free-space propagation of the amplitude distribution at the input plane 132, as shown 
in Figure 16. In Figure 20 we represent the input image obtained by phase-shifting 

20 interferometry without the reference phase mask 1 12. Figures 21 A and 2 IB show the 
encrypted phase and amplitude functions, whereas Figure 21 C corresponds to the 
intensity distribution obtained from these functions by inverse Fresnel propagation in 
the computer. The key phase and amplitude functions are shown in Figures 22A and 
22B. Finally, Figure 22C shows the decrypted image. Note that the quality of the 

25 image is almost the same as that in Figure 20. 

By the foregoing disclosure, a technique has been introduced to combine the 
high speed and the high security of optical encryption with the advantages of 
electronic transmission, processing, storage and decryption. Digital phase-shifting 
interferometry is exploited to use the limited CCD resolution more efficiently than 

30 can be done with off-axis digital holography. A three dimensional phase key in the 
Fresnel domain is used to provide high security. It has been described how this 
technique can be adapted to encrypt either the Fraunhofer or the Fresnel diffraction 
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pattern of the input signal Although Fresnel encryption requires a small increment of 
computation in the decryption process, the compactness, easy configuration of the 
optical system, and security improvement justify this second approach. Electronic 
decryption can be performed with a one-step FFT reconstruction procedure. 
5 The proposed system can potentially encrypt and decrypt data at video frame 

rates. As an initial demonstration of the concept, for the experiments reported herein 
the four-step method of digital phase-shifting interferometry is implemented 
manually. However, other phase-shifting methods can be used to optically encrypt 
data in real time. Also, an opto-acoustic device can be used to perform high-speed 

10 phase shifting, and a digital signal processing chip can be used to perform high-speed 
electronic reconstruction. 

In addition to allowing for electronic transmission of the encrypted 
information, the proposed system provides many degrees of freedom for securing 
information. It is also a convenient method for encrypting information in the optical 

15 domain such as real images and information stored in holographic media. Either 
optical or computer decryption techniques can be used with the proposed technique 
depending on the specific application. 

In Figure 12, an unencrypted hologram of the object 132, e.g., 
one formed without the use of random phase masks 1 12, 1 12a, may be formed at the 

20 output plane 130. Thus, in accordance with a third embodiment of the invention, a 
three dimensional optical display apparatus and method, based upon digital phase- 
shifting interferometry, may be used to record the fully complex information of a 
multi-dimensional object 132. Fourier and Fresnel domain optical recording is 
achieved by interfering the input object beam 102e and the reference beam 102a in an 

25 interferometer, such as a Mach-Zehnder phase-shifting interferometer 100. The 
recorded information can be transmitted over a distributed computer or 
communications network 400 via digital communication lines as in Figure 9. 
However, the computers 402, 404, 504, display devices 412, 412a and other devices 
of the networks 400, 500, 504 in Figure 9 are configured to execute program software, 

30 that allows them to send, receive, record, store and process compressed and 

decompressed holograms or sets of data between and amongst themselves via the 
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networks 400, 504 and the Internet 500. Such processing includes, for example, 
various image compression and decompression methods applied to the recorded 
interferometric information of the three dimensional object 132 before electronic 
transmission or storage thereof Similar methods can be applied to decompressed 
5 information before reconstruction of the three dimensional object 132. The 

processing also includes filtering, contrast enhancement, image sharpening, noise 
removal and correlation for image classification. Decompressed images may be 
displayed on display devices such as liquid crystal displays, liquid crystal TVs, or 
electrically or optically addressable spatial light modulators for applications in three 

10 dimensional TV and three dimensional display. This embodiment has applications in 
the serial three dimensional imaging of moving objects, such as in three dimensional 
TV, three dimensional video, three dimensional movies as well as three dimensional 
display and three dimensional visualization and other similar applications. Thus serial 
images may be formed of moving objects by forming a series of original holograms of 

15 the moving objects; compressing the series of original holograms of the moving 
objects to form a series of compressed holograms; decompressing the series of 
compressed holograms to form a series of decompressed holograms; and 
reconstructing the moving objects from the series of decompressed holograms to form 
a series of multi-dimensional images of the moving objects. 

20 The reconstruction is performed immediately and directly upon the fully 

complex information and, if performed electronically, requires no more computation 
than the usual image reconstruction procedures. After decompression, electronic 
reconstruction with a one-step fast Fourier transform (FFT) procedure or optical 
reconstruction methods can be applied. The three dimensional or multi-dimensional 

25 reconstruction of the object 132 can be performed either electronically, optically or 
optoelectronically as in Figures 13 A and 13B respectively. 

Thus, a digital hologram of the object 132 may be formed in the output plane 
130 and then compressed by signal compression methods. The compressed digital 
hologram may then be transmitted to remote locations over digital communications 
30 lines whereat the digital hologram is decompressed. The object 132 is then 
reconstructed from the decompressed digital hologram. 
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It will be recognized that the holograms formed at the output plane 130 are not 
limited to the in-line holograms of Figures 1, 10, 1 1 and 12, but may also be formed 
by off-axis holograms as is well known in the art. 

The following are incorporated herein by reference: B. Javidi and E. 
5 Taj ahuerce, "Three Dimensional Image Processing And Reconstruction" International 
Symposium On Photonics For Aerospace Application Of Optics, SPIE Proceedings 
Vol. 4043, Orlando Fla., April 24 - 28, 2000; U.S. Patent Application No. 
09/493/692, entitled " Optical Security System Using Fourier Plane Encoding" and 
filed January 28, 2000. 

10 While preferred embodiments have been shown and described, various 

modifications and substitutions may be made thereto without departing from the spirit 
and scope of the invention. Accordingly, it is to be understood that the present 
invention has been described by way of illustration only, and such illustrations and 
embodiments as have been disclosed herein by reference are not to be construed as 

15 limiting the claims. 
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